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ABSTRACT: Accurate counting and sizing of protein particles has been limited by discrepancies of counts obtained by different methods. 
To understand the bias and repeatability of techniques in common use in the biopharmaceutical community, the National Institute of 
Standards and Technology has conducted an interlaboratory comparison for sizing and counting subvisible particles from 1 to 25 um. 
Twenty-three laboratories from industry, government, and academic institutions participated. The circulated samples consisted of a poly- 
disperse suspension of abraded ethylene tetrafluoroethylene particles, which closely mimic the optical contrast and morphology of protein 
particles. For restricted data sets, agreement between data sets was reasonably good: relative standard deviations (RSDs) of approximately 
25% for light obscuration counts with lower diameter limits from 1 to 5 wm, and approximately 30% for flow imaging with specified man- 
ufacturer and instrument setting. RSDs of the reported counts for unrestricted data sets were approximately 50% for both light obscuration 
and flow imaging. Differences between instrument manufacturers were not statistically significant for light obscuration but were significant 
for flow imaging. We also report a method for accounting for differences in the reported diameter for flow imaging and electrical sensing 
zone techniques; the method worked well for diameters greater than 15 um. © 2014 Wiley Periodicals, Inc. and the American Pharmacists 
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INTRODUCTION 


Protein particles, consisting of aggregated protein and possi- 
bly a nonprotein nucleating core, can form in biopharmaceuti- 
cal drugs.’” Stresses that can lead to the formation of protein 
particles include changes in chemical environment, exposure 
to interfaces, agitation, elevation of temperature, or the intro- 
duction of nonprotein particles.*-’ Counting and characteriz- 
ing these particles is necessary to assure the quality of these 
drugs. Although the size of aggregated proteins may vary from 
10s of nanometers to 100s of micrometers, the most sensitive 
analytical techniques cover the approximate range from 1 to 
100 pm.?* 

In contrast to possible nonprotein impurities (e.g., glass 
chips, stainless steel particles, and fibers) protein particles 
have low optical contrast (equivalent to a small refractive in- 
dex difference from the matrix fluid) and are subject to dynamic 
changes in size and concentration as particles are formed or dis- 
solve back into solution.*°° Industry has made great strides 
in adopting new technologies to count protein particles rou- 
tinely down to sizes of approximately 2 um, but particle counts 
obtained with different types of instruments often differ by 
as much as a factor of 10." Particle counting instruments 
are commonly calibrated using polystyrene latex (PSL) beads, 
which have high optical contrast and spherical shape; the ob- 
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served count discrepancies indicate that instrument calibra- 
tions with PSL beads do not suffice to standardize instrument 
response to protein particles. 

Comparison of analytical measurements of particle size and 
count has been hampered by the instability of the protein parti- 
cles themselves, which can aggregate further on shipping or re- 
vert back to smaller aggregates or monomer protein molecules. 
As an alternate path to producing a suitable reference mate- 
rial, the National Institute of Standards and Technology (NIST) 
is developing a reference material comprising irregular parti- 
cles of a low-refractive index fluoropolymer, ethylene tetrafluo- 
roethylene (ETFE). The morphology and optical contrast of this 
material closely resembles that of typical protein particles. 

As an initial step in implementing this reference mate- 
rial and to assess the level of agreement among different 
laboratories, NIST has conducted an interlaboratory com- 
parison for sizing and counting subvisible particles from 1 
to 25 wm, using a polydisperse polymer suspension that 
closely mimics actual protein particles. As listed in Table 1, 
a total of 23 laboratories participated, including 15 from 
biopharmaceutical manufacturers, one from biomedical de- 
vice manufacturers, two from instrumentation manufacturers, 
three from government laboratories, and two from academic 
laboratories. 

This paper describes the design, production, and character- 
ization of the particles (section Materials and Methods); gives 
an overview of the bias between different counting methods 
(section Results and Discussion); and then discusses results 
for the four methodsê!? used by participants: flow imaging,’ 
light obscuration, electrical sensing zone (ESZ),'+! and reso- 
nant mass measurement (RMM)'° (sections Overview and Iden- 
tification of Outliers to Resonant Mass Measurement). Sections 
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Amgen, Inc., Formulation and Analytical Sciences, Thousand Oaks, California 

BD Medical, Pharmaceutical Systems, Pharmaceutical technology/R&D, Pont de Claix, France 

Biogen Idec, QC Analytical Technology, Research Triangle Park, North Carolina 

Bristol Myers Squibb, Biologics Analytical Development and Testing, Pennington, New Jersey 

Boehringer Ingelheim Pharma GmbH and Company KG, Biopharmaceuticals, Biberach an der Riss, Germany 


Coriolis Pharma, Martinsried, Germany 


Eli Lilly and Company, Biopharmaceutical Research and Development, Indianapolis, Indiana 
F. Hoffmann-La Roche Ltd, Pharma Technical Development Europe (Biologics), Basel, Switzerland 
Food and Drug Administration,” Laboratory of Plasma Derivatives, Center for Biologics Evaluation and Research, Bethesda, Maryland 


Fluid Imaging Technologies, Yarmouth, Maine 


Genentech, Inc., Roche Group, Late Stage Pharmaceutical and Processing Development, South San Francisco, California 


Hach Company, Grants Pass, Oregon 


GlaxoSmithKline R&D, Biopharm Product Sciences (BPS), King of Prussia, Pennsylvania 
GlaxoSmithKline (formerly Human Genome Sciences), Gaithersburg, Maryland 
Health Canada, Centre for Biologics Evaluation, Biologics and Genetic Therapies Directorate, Ottawa, Canada 


Janssen R&D, Schaffhausen, Switzerland 


MedImmune, Formulation Sciences Department, Gaithersburg, Maryland 
National Institute of Standards and Technology, Bioprocess Measurements Group, Gaithersburg, Maryland 


Novartis Pharma AG, Biologics Process R&D, Basel, Switzerland 


Pfizer, Inc., Biotherapeutics Pharmaceutical Sciences, Chesterfield, Missouri 

Sandoz Biopharmaceuticals, Pharmaceutical and Device Development, Drug Product Analytics, Sandoz GmbH, Langkampfen, Austria 
University of Kansas, Department of Pharmaceutical Chemistry, Macromolecule and Vaccine Stabilization Center, Lawrence, Kansas 
University of Leiden, Leiden/Amsterdam Center for Drug Research, Department of Drug Delivery Technology, Gorlaeus Laboratories, 


Leiden, The Netherlands 


“Although US FDA laboratory participated in the scientific study and/ or discussion, please note that FDA does not recommend, endorse, or recognize this standard 
development and further, the content of this communication represents the authors’ views and does not bind or obligate FDA. 


Particle Morphology and Resonant Mass Measurement also de- 
scribe an initial attempt to adjust the reported diameter of ESZ 
instruments to be equivalent to the diameter reported by flow 
imaging instruments. 

The results give a snapshot of the level of agreement be- 
tween different laboratories for the particle counting meth- 
ods in common use today in the biopharmaceutical industry. 
As expected from published results on protein particles, par- 
ticle counts differed significantly depending on the counting 
method. For each specific method, statistically significant devi- 
ations were observed primarily because of differences in instru- 
ment response. There were also several outliers (~10% of the 
reported data) likely related to insufficient resuspension of the 
ETFE particles and contamination of the ETFE particles by 
debris from vial-thread abrasion. Surprisingly, data obtained 
by light obscuration agreed well for small diameter particles 
[relative standard deviation (RSD) of <26% for lower diameter 
limits from 1 to 5 pm], but the level of agreement was signif- 
icantly worse for large particles. For flow imaging, there were 
statistically significant differences between data sets acquired 
on different instrument models, resulting in a large variability 
of counts (RSD values of 33%-61% for all flow imaging data). 
For specified instrument settings and models, the variability 
was reduced, with RSD values of 13%—49% over the full size 
range of the comparison. ESZ instruments gave anomalously 
high counts for the lowest diameter limits. 


MATERIALS AND METHODS 
Preparation of the Particle Suspension 


The samples circulated for testing consisted of a polydisperse 
suspension of particles created from the polymer ETFE. ETFE 
is attractive because it has low refractive index” (~1.40, simi- 
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lar to that of protein films adsorbed on surfaces'®) and is chem- 
ically inert and mechanically strong.” 

The particles were produced by abrading a solid polymer 
sample of ETFE against a diamond lapping disc. Although the 
process of producing the ETFE particles in no way corresponds 
to the aggregation mechanism of actual protein particles, the 
morphology of the ETFE particles is remarkably similar to pro- 
tein particles. Thus, the ETFE particles can serve as a surro- 
gate to actual protein particles, with similar morphology and 
optical contrast. Like actual protein particle suspensions, but 
unlike PSL standards, the ETFE suspensions are polydisperse, 
with particles ranging in approximate sizes from greater than 
50 pm down to less than 0.5 pm. 

We produced polydisperse ETFE particles by first abrading 
ETFE against a diamond abrasive (45 um nominal grit size, 
nickel bonded to a compliant backing) while submersed in an 
aqueous solution of 0.03 mol/L 2-[4-(2-hydroxyethyl)piperazin- 
1-yllethanesulfonic acid (HEPES) and 0.1% mass concentra- 
tion sodium dodecyl sulfate (SDS) buffered to pH 6 (we in- 
tended to use pH 7.5, but inadvertently used a pH 6 buffer for 
the particle fabrication). At approximately 1 h intervals, the 
particle suspension was withdrawn by pipette from the well 
holding the abrasive disc. To prevent clogging of analytical 
instruments, large particles were filtered out by passing the 
suspension through a nylon screen with nominal 53 um square 
openings. The nylon screen did not shed an appreciable number 
of particles if it was securely mounted, not folded or manipu- 
lated during the filtering process, and thoroughly rinsed with 
particle-free water prior to use. As harvested, the particle count 
was too high for direct measurement in some instruments. The 
suspension was diluted to the desired particle count with ad- 
ditional HEPES/SDS solution buffered to a pH of 7.5. Prior to 
use, the HEPES/SDS solution was filtered through a 0.45-ym 
PVDF syringe filter (Millex-HV; EMD Millipore, Billerica, 


Ripple, Montgomery, and Hu, JOURNAL OF PHARMACEUTICAL SCIENCES 104:666-677, 2015 


668 RESEARCH ARTICLE — Pharmaceutical Biotechnology 


Massachusetts). (Certain commercial equipment, instruments, 
or materials are identified in this document. Such identifica- 
tion is not intended to imply recommendation or endorsement 
by the National Institute of Standards and Technology, nor is it 
intended to imply that the products identified are necessarily 
the best available for the purpose.) The large concentration of 
SDS proved necessary to promote dispersion of the highly hy- 
drophobic ETFE particles: measurements on suspensions with 
an SDS concentration below 0.03% mass concentration had 
poor repeatability. 

The suspension was packaged in perfluorinated alkoxy (PFA) 
screw-top vials with flat interior bottoms. PFA has several 
desirable attributes. First, PFA, with its low refractive index 
(1.34), does not produce thread debris of high optical contrast 
on repeated opening and closing of the vials. Second, the PFA 
vials have minimal leachates. Initial studies with glass screw- 
top vials revealed unacceptable quantities of debris created 
by friction between the screw top and the vial. Studies with 
polypropylene vials revealed that strong agitation (necessary 
to resuspend the ETFE particles) would produce long-lasting, 
vesicle-like droplets, likely as a result of combining SDS with 
organic leachates. These observations motivated the switch to 
the more expensive PFA vials. 

Transfer of homogeneous aliquots of ETFE solution to a large 
number of vials is hampered by the fast settling of the ETFE 
particles relative to PSL beads. The ETFE particles were main- 
tained in suspension in a 400 mL, open-top PFA jar by placing 
four stainless steel baffles around the periphery of the jar and 
then stirring at 200 revolutions per minute.” From this stirred 
jar, the suspension could be transferred by pipet into the PFA 
vials. Once in the vials, the suspension was further diluted by 
addition of the 0.03 mol/L HEPES, pH 7.5, 0.1% mass concen- 
tration SDS solution. 

The threaded joint of the PFA vials can leak because of cold 
flow of the PFA over the course of several days. To prevent this 
problem, the vials were tightened after sitting overnight, and 
again after 7 days from the filling date. Rocking the lids back 
and forth while tightening also helped to promote a tight seal. 
Participants weighed the vials on receipt to ensure that the 
vials had not leaked during shipping; all vials were successfully 
shipped without leakage. 

The vials were stored and shipped to participants at ambient 
temperature. 


Characterization of the Particle Suspension 
Variability of the Particle Concentration 


On initial production, there are vial-to-vial variations in parti- 
cle count because of irrepeatability of the dispensing and dilut- 
ing process. After initial production, there are several potential 
mechanisms for further changes of the particle size distribu- 
tion. As examples, agitation because of shipping or resuspen- 
sion can potentially either break apart particles or cause abra- 
sion of the PFA vials; sedimentation and natural convection can 
lead to entanglement of particles; and resealing the threaded 
closures can add abraded PFA particles. 

To quantify vial-to-vial variations and possible changes in 
particle size distribution during storage, five vials were mea- 
sured by light obscuration over a 3-month period correspond- 
ing to the period of data collection by the participants. Changes 
in particle size distribution were estimated from the changes 
observed for a single vial shipped from Maryland to California 
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and back again. Separate experiments were conducted to re- 
peatedly reseal three vials (which can lead to creation of thread 
debris), and measure the particle size distribution periodically 
by both light obscuration and flow imaging, for a total of 30 seal- 
ing cycles. The vial stability tests were conducted with multiple 
vials, opened at staggered time points, to reduce the effects of 
vial resealing on the stability test. 

From the variations observed in these experiments, the stan- 
dard uncertainty was determined for each effect, which is equiv- 
alent to the expected variations of any one vial from the mean 
of all vials at a confidence limit of 68% (i.e., equivalent to one 
standard deviation). The combined uncertainty u, (i.e., the un- 
certainty attributed to all terms) was calculated by taking the 
square root of the sum of the squares of all uncertainty com- 
ponents. (The results of this analysis are given in the Supple- 
mentary Information as Table S1.) The value of u. is an accept- 
able 8% for particle concentrations with a lower size limit of 
5 um or lower. For higher limits, u. climbs to 19% at a lower 
limit of 25 um. The larger value of u. for a lower limit of 
25 um results at least in part from the low particle concen- 
tration in that size range, with N ~ 80 mL“! (mL! is the 
unit symbol designating units of particles per milliliter). This 
low value increases the impact of small numbers of additional 
contaminants. 

Although the stability of the ETFE particle suspension was 
sufficient for the purposes of this comparison, some drift in re- 
sults were noted by both NIST and one participant. Part of this 
observed drift is likely because of thread debris, as discussed 
in section Overview and Identification of Outliers. One possible 
additional source of drift is microbial growth: despite the abil- 
ity of SDS to denature proteins, bacteria have been observed to 
degrade SDS at concentrations in excess of the 0.1% mass con- 
centration used here.”!?? Subsequent to the data acquisition 
phase of the comparison, a stability test was initiated on ETFE 
particle suspensions of similar particle size distribution, but 
with the addition of 0.02% mass concentration of sodium azide 
and with greater care in filtration of the buffer. The stability 
of this second lot over 6.5 months was a factor of 1.9 better 
than the stability of the comparison lot over 3 months (data not 
shown). 


Particle Morphology 


We examined the particle morphology using both optical and 
electron microscopy. Examples of both types of images are 
shown in Figure 1. Optical images of the ETFE particles were 
acquired in suspension, using a flow imaging system with 10x 
magnification and a 100-ym thick flow cell. 

Optical imaging of the ETFE particles is limited by the 
resolution of optical microscopy; scanning electron microscopy 
(SEM) has the potential of providing images with much higher 
resolution. However, the particles must be deposited on a sub- 
strate in such a way that the particles do not agglomerate on 
drying and must have the high SDS and HEPES concentration 
washed off. For SEM imaging, the particles were first captured 
on anodized alumina filters (Anodisc brand; GE Healthcare 
Bio-Sciences, Pittsburgh, Pennsylvania) with 0.2 um diameter 
pores. Prior to use, the filters were first washed with water and 
then with a mixture of photoresist remover and ethanol. After 
oven drying, the filters were sputter coated on both sides with 
25 nm of a Au/Pd alloy. The coated filter was placed on the glass- 
frit support of a vacuum flask, and 300 u L of water was pipetted 


DOI 10.1002/jps.24287 


RESEARCH ARTICLE — Pharmaceutical Biotechnology 669 


Figure 1. Example images of ETFE particles by (a) flow imaging, using 10x magnification, and (b) SEM of particles captured on a nanoporous 


alumina filter. 


onto the top of the filter to form a nearly hemispherical “dome” 
on the hydrophobic Au/Pd film, whereas a slight partial vac- 
uum (1.3 kPa, as determined by a vacuum manometer) was 
applied to the flask, sufficient to draw liquid through the filter 
at approximately 0.6 mL/min. A 100-uL sample of the ETFE 
suspension was slowly pipetted into the center of the dome; 
as the dome returned to an approximate volume of 300 uL, 
100 uL of water was slowly pipetted into the top of the dome. 
This process was repeated until the desired particle count was 
achieved. The particles were then rinsed by 10 successive addi- 
tions of 100 uL of water. After the rinse step, the vacuum was 
maintained to draw the water fully through the filter. Following 
drying of the filter in place, the filter was removed and a 25-nm 
top coat of Au/Pd film was sputter deposited. SEM images were 
obtained on a Zeiss scanning electron microscope at an electron 
energy of 5 keV, with both in-lens and conventional secondary 
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electron detectors. Dispersive X-ray analysis conducted on the 
SEM confirmed that we were imaging fluorocarbon particles. 

Inspection of the microscopic images shows them to be ir- 
regular and somewhat fibrous. We wished to characterize the 
average fraction of solid ETFE within the overall envelope of 
the particle, in anticipation that this packing fraction would 
help us understand differences in the particle counts obtained 
by different methods. The technique of quantitative phase 
microscopy”** produces a phase map of the apparent optical 
phase difference (x, y), which is proportional to the differ- 
ence in optical thickness between the particle and the matrix 
liquid: 


2TANEZE 


h | (1) 


p(x, y) = 
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where Ang is the refractive index difference between solid 
ETFE and the matrix liquid, zg is the total thickness of ETFE 
in the vertical z direction, x and y are lateral dimensions in the 
image plane, and Ay is the wavelength of light in vacuum. In- 
tegrating Eq. (1) over the whole area of the particle relates the 
integral of the optical phase difference over the whole particle 
area, ®, to the total volume displaced by solid ETFE, V: 


a 2nAngV- (2) 
ho 

From the literature, the refractive index of ETFE, at the 
wavelength of 527 nm used here, is 1.400." From measure- 
ments with a calibrated Abbe refractometer, the HEPES/SDS 
buffer has a refractive index of 1.337, giving Ang = 0.063 in 
Eqs. (1) and (2). 

Published literature for objects with a thickness compara- 
ble to the width and length report that correcting phase val- 
ues from the thin-object algorithm of Paganin and Nugent”? 
by a factor of either two to five (varying with object size and 
using white light illumination)?‘ or one (using highly coher- 
ent light). In our implementation, we used partially coherent 
green light at a wavelength of 527 nm. To determine the cor- 
rection factor, we suspended small glass beads in two liquids 
(one with negative An and one with positive An) and obtained a 
correction factor of 2.0 + 0.1 (median and standard uncertainty 
of the median”®) that was approximately independent of bead 
size (see Fig. S1, Supporting Information). 

Two of the counting methods reported in this comparison, 
ESZ and RMM techniques, report equivalent diameters dy that 
are equal to the diameter of a sphere with volume V: 


V = (n/6) dé. (3) 


Flow imaging reports an effective diameter, dp, that is either 
an average of dimensional measurements across the optical 
image or the diameter of a circle with the same area as the 
imaged particle: 


A = (x/4) dp. (4) 


The final method, light obscuration, reports a diameter that 
is based on an angle integration of scattered light, which is not 
directly related to the physical particle dimensions. 

To determine the relation between dy and dr for the ETFE 
particles, we obtained brightfield images on a number of ETFE 
particles in suspension in the matrix liquid (using Kohler il- 
lumination at a wavelength of 527 nm, with a 20x magni- 
fication, 0.40 numerical aperture objective). As the particles 
settled to the bottom of the counting chamber, the long axis 
of the particles was approximately normal to the optical axis. 
Thus, the particles were similar in orientation to particles that 
were aligned along the flow direction in the flow cell of a par- 
ticle counter. We denote the effective diameter of aligned and 
randomly oriented particles as dy, and drp, respectively. Di- 
rect analysis of the brightfield images using ImageJ software?’ 
gave the projected area of each particle, and by Eq. (4), a value 
of dpa. Quantitative phase analysis of two images obtained at 
a focal plane difference of 2 um gave the phase map Q(x, y), 
from which we obtained dy by Eqs. 1-3. From an analysis of 80 
particles ranging in diameter from 2 to 29 um, we determined 
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that the average ratio dy/dp, varied smoothly from a value of 
0.90 + 0.10 (mean and standard error of the mean for 13 parti- 
cles) at 2 um diameter to 0.51 + 0.02 (mean and standard error 
of the mean for 10 particles) at 20 um diameter. For randomly 
oriented particles, there is a small correction because of the 
difference between the average cross-sections of a randomly 
oriented particle and the cross-section of an aligned particle. 
Approximating the particles as prolate spheroids with aspect 
ratio n% 0.6 (see Table S2 in the Supplementary Information) 
gives a ratio” dpa/dpr = "° = 1.08 as a correction factor to 
convert dy/dra to dy/dyr. 


Absolute Particle Concentration 


For the purposes of the present interlaboratory comparison, 
we did not determine a particle size distribution traceable 
to the International System of Units. To do so requires care- 
ful development of techniques to size and count particles 
with minimal bias. On successful development of appropri- 
ate techniques, we plan to release this ETFE suspension 
as a reference material certified for particle size distribu- 
tion and morphological properties such as the average aspect 
ratio. 


Comparison Protocol 


The testing of the ETFE particles was much more challenging 
to the participating laboratories than measurement of commer- 
cial PSL-bead count standards. The participants were not given 
the particle count or the particle size distribution, and the poly- 
disperse nature of the sample made it hard to distinguish true 
particles from any contaminants or other source of spurious 
counts. In this regard, measurement of the ETFE was very sim- 
ilar to measurement of an actual biotherapeutic candidate or 
product. The protocol and data reporting template did not spec- 
ify the type of instrumentation to be used for this, although the 
template did include columns already set up for the two most 
prevalent methods: flow imaging and light obscuration. 

One parameter in which the ETFE differs substantially from 
PSL beads is its high density, which causes ETFE particles 
to sediment much faster than PSL beads of the same hydro- 
dynamic radius. To mitigate this effect, guidance on methods 
to reduce sedimentation effects was distributed to the partici- 
pants. 

The high density of the ETFE, combined with the irregular 
morphology, can lead to entanglement of the ETFE particles 
following sedimentation. Prior experiments at NIST demon- 
strated that the best method to resuspend particles was to hold 
the vials horizontally and then shake vigorously for 20 s. This 
method resuspended particles much more effectively than ei- 
ther sonication or vortexing. The protocol (see the Supporting 
Information) gave instructions to the participants on this re- 
suspension technique. 

To maintain confidentiality, all data were submitted to 
a third-party data handling organization, which submitted 
anonymous data to NIST. Data was reported by the participants 
using a spreadsheet template. The template included columns 
for instrumentation type and settings, the particle concentra- 
tions for equivalent diameters equal to or greater than 1, 2, 5, 
10, 15, 20, and 25 pm, and standard deviations of the obtained 
concentrations. 
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RESULTS AND DISCUSSION 


Overview and Identification of Outliers 


Of the 24 laboratories reporting data, data from 22 laboratories 
are fully reported here, along with half the data from one other 
laboratory. Complete records of all 24 data sets are available in 
the Supporting Information (round 1 data sets); data sets are 
identified by the laboratory code assigned by the data-handling 
organization. In some cases, laboratories reported data for mul- 
tiple instruments of the same type (e.g., flow imaging micro- 
scopes) but different models; these reported values were treated 
as independent data sets. 

Data from three laboratories were identified as outliers (lab- 
oratory codes B4893, B2899, and H2894; full data sets included 
in Supporting Information). For laboratory code B2899, the 
counts were consistently high for three different counting meth- 
ods, indicating some contamination or failure of the transfer 
standard. In an effort to identify the cause of the discrepancy, 
an additional sample of ETFE (labeled as round 2 in the Sup- 
porting Information) was sent to this laboratory. The laboratory 
returned both the data reporting sheet and a detailed sheet of 
raw data. From the raw data, it became apparent that this par- 
ticipant acquired more replicates than almost all other partic- 
ipants and that the anomalies were greatest at large particle 
size and near the end of the sample volume. This pattern is 
consistent with contamination of the sample with thread de- 
bris. The magnitude of the effect is larger than included in the 
uncertainty budget for two reasons: the number of replicates 
was quite high, and the NIST experiments did not draw down 
the sample volume as rapidly as the B2899 experiments (as 
the sample volume decreases, a given amount of added thread 
debris will have a larger proportional effect). To mitigate the 
effects of thread debris on this data set, we included only the 
first set of three replicates obtained by B2899. On doing so, this 
data set was no longer an outlier. 

For laboratory code H2894, counts were especially high at 
large diameter limits for flow imaging, but not for light ob- 
scuration. Inspection of the dates of data acquisition revealed 
that the flow imaging data were taken after a large volume of 
the sample was used for light obscuration data. On the basis 
of the pattern of discrepancies, which was similar to that ob- 
served with B2899, it is possible that the H2894 flow imag- 
ing data set was similarly affected by thread debris. Flow 
imaging data for H2894 was not included in the analysis 
below. 

Finally, for laboratory code B4893, particle counts were con- 
sistently low for both flow imaging and light obscuration. In- 
sufficient resuspension of the ETFE particles may have caused 
these low counts. Data for B4893 were not included in the anal- 
ysis below. Additional observations about the various data sets 
and sources of discrepancies are discussed in the sections below. 

The predominant methods used by the participants were 
light obscuration (19 data sets) and flow imaging (25 sets). 
Three laboratories also measured the suspension using ESZ 
instruments (commonly known as Coulter counters), and one 
laboratory reported data using resonance mass measurement. 
Figure 2 and Table 2 present the average of the cumulative 
particle concentration N (i.e., count per milliliter for particles 
greater than or equal to the indicated diameter) and the rela- 
tive standard deviation among the laboratories for the 20 data 
sets, for these four particle counting methods. 
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Figure 2. Unweighted means of the cumulative particle concentra- 
tion N as a function of the lower diameter limit d for four particle count- 
ing methods. Error bars indicate standard deviations of the reported 
data sets, and the number of data sets in each average is reported in 
parenthesis. 


As expected, the light obscuration values lie considerably 
lower in count than the flow imaging values. The cause of this 
reduced count is known to be because of the small refractive in- 
dex difference between the particles and the matrix fluid, which 
leads to the light obscuration instruments reporting diameter 
values that are lower than observed by flow imaging.!°”° For 
the ETFE particles used in this comparison, light obscuration 
undersizes the particles by approximately a factor of two, rela- 
tive to flow imaging. This factor can be determined by finding 
the ratio of flow imaging diameter to light obscuration diameter 
for a fixed particle concentration. 


Flow Imaging 


The comparison data included data from multiple models of 
flow imaging systems manufactured by two companies (see 
Fig. 3). Participants obtained data using a wide range of sys- 
tem magnification (4x to 20x), flow cell depth (80-400 um), 
and particle identification algorithms. 

As a result of differences between instrument response, the 
RSD values for all of the combined flow imaging data sets 
ranged from 33% to 61%, as listed in Table 3. Selected data 
sets showed better RSD values. For instruments from man- 
ufacturer A, RSD values ranged from 21% to 36% (n = 18), 
even with flow cells of both 100 and 400 um thickness and 
several magnifications. For instruments from manufacturer B, 
with 10x magnification, capture thresholds that selected both 
dark and light pixels, and 80 or 100 um flow cell thickness (n 
= 4), RSD values ranged from 38% to 49%. We applied a two- 
tailed, unpaired T-test to ascertain the statistical significance 
of the apparent differences in counts obtained from these two 
restricted data sets. For diameter limits of 5 um and larger, 
the t-test showed statistical significance at greater than 95% 
confidence (i.e., p < 5%). 
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Table 2. Mean Cumulative Concentration N, Relative Standard Deviation RSD, and Number of Data Sets n for Four Measurement Techniques 
Flow Imaging Light Obscuration ESZ RMM 
N RSD N RSD N RSD N RSD 
d (um) (mL!) (%) n (mL!) (%) n (mL!) (%) N (mL7}) (%) n 
1 9858 33 15 4882 9 4 NA NA 0 38,967 NA 1 
2 4515 55 24 1241 40 19 12,700 NA 1 NA NA 0 
5 1822 60 25 457 54 18 2217 17 3 NA NA 0 
10 705 43 25 140 86 19 438 39 3 NA NA 0 
15 363 42 24 39 63 16 152 54 3 NA NA 0 
20 204 51 23 13 55 15 63 57 3 NA NA 0 
25 118 61 25 5 68 19 24 43 3 NA NA 0 


Refer to the text regarding adjustments to the data set. 
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Figure 3. Flow imaging data for the cumulative particle concentra- 
tion N as a function of the lower diameter limit d. Data obtained from 
manufacturer A instruments are red-filled diamonds and solid lines for 
100 um thick flow cells and red open diamonds and dashed lines for 
400 um thick flow cells. Data from manufacturer B instruments are 
black dots and solid lines for 10x magnification and known dark and 
light thresholds applied; black circles and dashed lines for 10x mag- 
nification and dark only or unknown thresholds; and blue squares and 
lines for 20x magnification. Each symbol reports the mean of multiple 
measurements obtained by the reporting laboratory for each data set; 
error bars are omitted for clarity, but repeatability values may be found 
in the Supporting Information. 


For manufacturer B, many of the instruments had variable 
detection thresholds and user-specified focus. Referring to Fig- 
ure 3 (open black circles), two data sets using manufacturer B 
instruments at 10x magnification and either dark threshold 
only or unidentified threshold had counts that were very close 
to those of manufacturer A results, whereas four of five data 
sets with both dark and light threshold settings gave counts sig- 
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nificantly higher than manufacturer A instruments. This sug- 
gests that standardization of threshold settings may be useful 
in achieving better reproducibility between laboratories. 

Two data sets using an instrument from Manufacturer B 
set up with 20x magnification gave counts for larger particles 
considerably lower than other data sets obtained using 10x 
magnification (blue symbols in Fig. 3). A possible reason for 
this discrepancy is that the short depth of field of the 20x 
objective, coupled with the irregular, low-contrast nature of the 
ETFE particles led to particles far from the focal plane not 
being detected. 

Flow imaging instruments are capable of measuring a large 
number of morphological parameters for particles larger than 
the optical resolution of the system. The data reporting tem- 
plate included an option to report the average measured aspect 
ratio for the different size bins. The reported values agree quite 
well except for one outlier. Standard deviations for the different 
size ranges varied from 0.04 to 0.18 with the outlier included, 
or from 0.04 to 0.07 for all the data (see Table S2 in the Sup- 
plementary Information). No statistically significant difference 
was observed between results obtained with different manufac- 
turer’s instruments. The aspect ratio values (0.62 for particles 
larger than 10 pm) clearly indicate the nonspherical nature of 
the ETFE particles. 

Two participants (A2813 and L2493) obtained data using 
robot-loaded flow imaging systems. The robotic systems have 
automated sample stirring, priming of the flow cell, and mea- 
surement of particles. At the beginning of the comparison, it 
was not clear whether the standard instrumentation software 
could accommodate the ETFE standards, given the tendency of 
the ETFE to sediment. In fact, these data sets showed excel- 
lent repeatability, with RSD varying from 2% to 9%. One other 
participant (W2481) submitted two sets of data obtained by 
loading two flow imaging systems from a continuously stirred, 
open syringe, obtaining data consistent with other data sets. 

Comparison participants voiced concerns over sedimenta- 
tion of the ETFE. Sedimentation velocity of a spherical body 
increases as the square of the diameter. Consequently, neglect- 
ing the impact of variations in geometry with particle size, a 
25-um particle would have a sedimentation velocity 2.8 times 
larger than a 15-ym particle. Examining how the deviations 
of outlier data sets varied with diameter showed no obvious 
patterns characteristic of errors that would scale as d?. 

The repeatability reported by each participating labora- 
tory (RSD;) was excellent for the full range of diameter lim- 
its reported (see Table S3 in the Supplementary Information). 


DOI 10.1002/jps.24287 


RESEARCH ARTICLE — Pharmaceutical Biotechnology 673 


Table 3. Flow Imaging Data for Cumulative Concentration N, Relative Standard Deviation RSD, and Number of Data Sets n, for Different 


Values of the Lower Diameter Limit d 


Manufacturer A, 


Manufacturer A, Manufacturer B, 


All Data 100 pm Flow Cell 400 pm Flow Cell 10x Magnification, Dark, 
and Light Thresholds 
N RSD N RSD N RSD N RSD 
d (um) (mL!) (%) n (mL!) (%) n (mL!) (%) n (mL!) (%) n 
1 9858 33 15 9574 25 11 NA NA 0 13,943 NA 1 
2 4515 55 24 3707 22 12 3739 21 5 7794 44 4 
5 1822 60 25 1457 24 12 1170 25 5 3260 39 5 
10 705 43 25 616 28 12 520 21 5 1066 39 5 
15 363 42 24 312 36 11 281 14 5 528 38 5 
20 204 51 23 168 36 10 144 13 5 310 43 5 
25 118 61 25 91 36 12 83 14 5 199 49 5 


All participants achieved RSD; values less than 33% for diame- 
ter limits of 10 um or less, and 75% of participants (3"! quartile) 
had RSD; values less than 26% for the full range of diameters. 


Light Obscuration 


Light obscuration was the second most common method re- 
ported by the comparison participants, with 19 data sets, after 
flow imaging. Because of the small refractive index difference 
between ETFE and the buffer solution (An ~ 0.04), light obscu- 
ration reported significantly fewer counts than flow imaging 
or ESZ techniques.!°”? All of the data were obtained with in- 
struments from two manufacturers, with several instrument 
models for each manufacturer. The instruments of one manu- 
facturer had a lower diameter limit of 1.3 um. Several partici- 
pants reported the measured values for this limit, but data are 
not discussed further as this diameter limit was not one of the 
values on the data reporting template. 

As seen in Figure 4 and Table 4, and confirmed by a two- 
tailed t-test, there were no statistically significant differences 
between data obtained from the two brands of instruments, 
over the full diameter range of the comparison. Plotting the 
data did reveal that data obtained with sensor heads designed 
for a 2 to 400-u m diameter particle size had significantly poorer 
reproducibility than sensor heads designed for particles smaller 
than 150 um diameter. One participant (B2899, round 2) mea- 
sured a second sample of ETFE on two instruments that had 
different sensor model numbers but the same nominal 2-400 
um diameter range. This single laboratory obtained counts that 
differed by over a factor of 10 (Supporting Information, round 
2 data sheets, B2899-2). Further work should be carried out to 
understand why the reproducibility varies so much with rela- 
tively minor changes in sensor geometry. 

One participant (B2188) obtained data at a flow rate of 1 
mL/min and obtained particle concentrations that were anoma- 
lously low for large particle sizes. This effect is likely the result 
of ETFE sedimentation. 

As noted in Results and Discussion, the light obscuration 
counters report an effective diameter that is approximately 
a factor of two smaller than the diameter reported from flow 
imaging. Thus, a lower apparent diameter limit of 25 um for 
a light obscuration measurement corresponds to a physical di- 
ameter of approximately 50 um. As the ETFE suspension was 
filtered through a nominal 53 um screen in its preparation, the 
total count of particles with a 25-um lower diameter limit is 
nearly zero. 
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Figure 4. Light obscuration data for the cumulative particle concen- 
tration N as a function of the lower diameter limit d. Data obtained from 
manufacturer A instruments are red-closed diamonds and solid lines 
for data obtained at 10 mL/min, and red open diamonds and dashed 
lines for data obtained at 1 mL/min. Data from manufacturer B instru- 
ments are black dots and solid lines for instruments with a maximum 
diameter limit of 150 um, and black circles and dashed lines for instru- 
ments with a maximum diameter of 400 um. Each symbol reports the 
mean of multiple measurements obtained by the reporting laboratory 
for each data set; error bars are omitted for clarity, but repeatability 
values may be found in the Supporting Information. 


The RSD values for the complete light obscuration data set 
range from 9% to 86%, as shown in Table 4. With data removed 
for instruments with a size range from 2 to 400 um and from 
the one data set obtained at 1 mL/min, the RSD values are 9% 
at a lower diameter limit of 1 um, rise to 26% at 5 um, reach 
a peak of 54% for a lower diameter limit of 20 um, and then 
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Table 4. Light Obscuration Data for Cumulative Concentration N, Relative Standard Deviation RSD Between Laboratories, and Number of 
Data Sets n, for Different Values of the Lower Diameter Limit d 


Sensor Heads for d < 


Sensor Heads for 2 um < 


All Data 200 um; Flow Rate (10-25 mL/min) d < 400 pm Sensor Heads 
d (um) NL!) RSD (%) n N(mL-!) RSD (%) n N (mL-!) RSD (%) n 
1 4882 9 4 4747 9 3 NA NA 0 
2 1241 40 19 1387 26 13 913 76 5 
5 457 54 18 472 26 12 467 98 5 
10 140 86 19 126 42 13 195 115 5 
15 39 63 16 37 52 10 52 62 5 
20 13 55 15 14 54 9 15 44 5 
25 5 68% 19 4 52% 13 7 70% 5 
a P cles with low optical contrast, such as protein or ETFE particles, 
10,000 500 200 100 50 20 16 light obscuration has poor accuracy for all diameter limits (see 


0.4 


0.6 0.8 1.0 


Figure 5. RSD; values versus 1/P!” for both flow imaging (a) and light 
obscuration (b) data, where P is the number of particles measured per 
replicate. The solid line represents the expected RSD; values because of 
counting fluctuations alone, and the dashed line represents the upper 
bound for the contribution of counting fluctuations to RSD; at p < 5%, 
for three replicates. 


decline slightly at a diameter limit of 25 um, in spite of the very 
small concentration detected. 

The low-residual standard deviations for small diameter val- 
ues appear to be counterintuitive, as light obscuration counters 
are known to have sensitivity to the optical properties of par- 
ticles for diameters below approximately 10 um (which is one 
justification why 10 um is specified as the lower diameter limit 
in pharmacopeial methods*°), which leads to inaccurate counts 
even for particles of high optical contrast. For transparent parti- 
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Fig. S2 in the Supporting Information). Note, however, that the 
RSD between data sets is not a measure of the accuracy of the 
reported counts, but is instead a measure of the reproducibility 
of counts among similar instruments. The smaller RSD val- 
ues at small diameter limits may occur because small particles 
scatter light over a broader angle than large particles; the in- 
strument response may be less sensitive to details of aperture 
size and focus and alignment of the beam and flow cell. 

The good agreement between laboratories for a lower diam- 
eter limit down to 1 um demonstrates that light obscuration 
measurements can provide a repeatable, but not accurate, mea- 
sure of particle concentration down to sizes much smaller than 
the 10-um lower limit of pharmacopeial methods for samples 
of fixed optical contrast and morphology.°° 

The repeatability achieved by individual participants using 
light obscuration (see Table S4 in the Supplementary Informa- 
tion) appears to be significantly worse than that achieved with 
flow imaging, especially at large diameter limits. However, the 
poor repeatability in this case is partly because of undersiz- 
ing of particles by light obscuration and the correspondingly 
low values of N at diameter limits of 15 um and greater. At 
diameter limits of 10 um or smaller, which corresponds to an 
equivalent physical diameter limit of approximately 20 pm or 
smaller, RSD; values for light obscuration are less than 16% for 
75% of participants. 


Statistical Variations of Light Obscuration and Flow Imaging Data 


The particle size distribution of the ETFE suspension was con- 
strained by several factors. First, to provide a realistic simu- 
lation of protein particles, the particle size distribution should 
rapidly decrease with increasing values of diameter. Second, 
for some light obscuration instruments commonly used in the 
pharmaceutical industry, an error of >10% occurs for particle 
concentrations of 10,000 mL“! or higher, because of multiple 
particles traversing the sensing zone simultaneously. Finally, 
the number of particles with d > 100 pm must be nearly zero to 
avoid clogging instrument inlets. A significant consequence of 
keeping the overall concentration below 10,000 mL“! combined 
with the rapid reduction in N(d) as d increases is that signifi- 
cant errors can be introduced by the limited number of particle 
counts, especially for size bins of d > 15 ym and larger. 

The RSD; because of counting statistics is 1/P”?, where P 
is the number of particles measured per replicate. Figure 5 
shows RSD; values versus 1/P*? for both flow imaging (Fig. 5a) 
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and light obscuration (Fig. 5b) data. Values for P were calcu- 
lated from the reported measurement volumes and by assum- 
ing sampling efficiencies of 100% for light obscuration, 85% for 
flow imaging instruments from manufacturer A, and 35% for 
flow imaging instruments from manufacturer B. The solid line 
represents the expected mean RSD; values because of count- 
ing fluctuations, (100%)/P'*. The dashed line represents the 
upper bound for the contribution to RSD; from counting fluc- 
tuations, at a confidence level of p < 5% and three replicate 
measurements (i.e., F-distribution evaluated at 2 and infinite 
degrees of freedom, at a confidence level of 5%). Data have only 
a 5% likelihood of appearing above this line because of counting 
fluctuations alone. 

For the flow imaging data set, the RSD; values are tightly 
distributed for d > 1 um through d > 10 um data sets. The 
relative standard error of the mean of N(d) is obtained by di- 
viding RSD; by the square root of the number of replicates; 
thus, if counting fluctuations contribute less than 30% to the 
RSD,, relative SEM values of 17% are achievable with three 
replicates. The data sets for d > 20 um and d > 25 um illus- 
trate that most of the participants achieved RSD; values at this 
level for even the largest particle bins. There are two clear out- 
liers well in excess of counting errors for each of these bins, and 
several points with RSD; values near the p < 5% line. 

For light obscuration, the undersizing of particles combined 
with the steep drop in the particle size distribution led to small 
numbers of particles detected. As a result, identification of lab- 
oratories with poor repeatability is difficult, but the comparison 
has sufficiently low counting uncertainties to enable reasonable 
comparison (i.e., relative SEM < 17%) of average N(d) values 
for d > 15 um bin and smaller. 

Considering future formulations of particle suspensions, a 
fourfold increase in N(d) for d > 20 um and d > 25 pm would 
reduce the statistical uncertainty sufficiently to achieve a rel- 
ative SEM < 20% for light obscuration at all size bins and a 
more unambiguous identification of poor repeatability for flow 
imaging in size bins of 20 pm and larger. 


Resonant Mass Measurement 


One participant reported data using the RMM technique, con- 
verting particle mass into an effective diameter using litera- 
ture values for the ETFE density (+1700 kg/m*).!® Because the 
ETFE density differs widely from the buffer solution (unlike 
protein particles in solution), this measurement is not a strin- 
gent test of RMM, and the NIST organizers did not anticipate 
that a test of the particles by RMM would have particular value. 
However, on considering the data, measurement of ETFE by 
both RMM and flow imaging may provide a very useful cross- 
check of flow imaging. The discrepancy between the RMM and 
flow imaging at the lowest diameter limit (1 ym) may be a con- 
sequence of the reduced visibility of low-contrast particles in 
flow imaging systems. Further pursuit of this approach may 
provide a method of validating flow imaging systems near the 
lower diameter limit of these instruments. One difficulty in the 
interpretation of the RMM data is that the reported diame- 
ter is equal to the diameter of a compact ETFE sphere, which 
differs from the diameter derived from the projected area by 
flow microscopy. A challenge in performing RMM on the cir- 
culated ETFE suspension is that the particle concentration is 
too low to give RMM counts with low statistical uncertainty for 
the small sample volumes typically used for RMM. The value 
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Figure 6. Electrical sensing zone data for the cumulative particle 
concentration N as a function of the lower diameter limit d, for two 
different orifice sizes. The arrow denotes possible data anomalies. Er- 
ror bars indicate the standard deviation of the repeat measurements 
obtained by the reporting laboratory for each data set. 


of N(d = 2 um) reported in Table 2 for RMM is equivalent to 
approximately four particles per replicate. 


Electrical Sensing Zone 


Two participants reported data using the ESZ technique. A 
sharp, likely anomalous increase in apparent particle count 
was observed at diameters near the lower limit of the ESZ 
instruments, as shown in Figure 6 and Table 5. The lower limit 
of the ESZ measurements depends on the size of the orifice 
installed in the instrument, and the anomalous increase shifts 
with a change in orifice. Similar increases in particle counts 
have been observed with polydisperse suspensions of actual 
protein particles. Until the cause of the anomalous data can be 
ascertained, use of the ETFE suspension for ESZ instruments 
may be of limited value. 

Electrical sensing zone instruments report diameters based 
on the displaced volume of the particle; in contrast, flow imag- 
ing reports a diameter based on the projected area. For the 
irregular, convoluted morphologies of the ETFE particles, the 
volume-based diameter can be substantially smaller than the 
area-based diameter. We attempted to correct this bias using 
the ratio of these diameters obtained from quantitative phase 
microscopy, as described in section Particle Morphology. The 
corrected ESZ results, for either aligned or randomly oriented 
particles, agree well with the flow imaging results for a lower 
diameter limit of 15 um or larger, as seen in Figure 7. The 
method of section Particle Morphology leads to an apparent 
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Table 5. Electrical Sensing Zone Data for Different Values of the Lower Diameter Limit d Reported by the Participants (Equivalent to dy in 
Eq. (3), and the Scaled, Area-Based Diameters for Aligned and Randomly Oriented Particles, dr Ę and dpr, Obtained by the Method Discussed 


in Section Particle Morphology 


All Data Sets, Data Taken with Data Taken with 
Anomalous Data Removed 50 um Orifice 100 um Orifice 
dpa deR N RSD N 

d (um) (um) (um) mL} (%) n (mL!) RSD (%) n N(mL-!}) RSD (%) n 

1 1.63 1.50 NA NA 0 NA NA 0 3,081,067 NA 1 

2 3.26 3.00 12,700 NA 1 209,024 91 2 12,700 NA 1 

5 8.16 7.49 2217 17 3 2334 19 2 1983 NA 1 

10 16.3 15.0 438 39 3 515 29 2 283 NA 1 

15 24.5 22.5 152 54 3 187 43 2 83 NA 1 

20 32.6 30.0 63 57 3 78 45 2 33 NA 1 

25 40.8 37.4 24 43 3 28 Al 2 17 NA 1 
diameter limits between 1 and 5 um, the correction increases 
the discrepancy between the ESZ results and the flow imaging 
values. 

10 Because both RMM and ESZ instruments report an effective 
diameter based on the displaced volume, it is possible in the- 
ory to compare the results of these two types of instruments 
directly. In the present comparison, however, there is not suf- 
ficient overlap of the two data sets to allow a comparison. The 
one participant reporting RMM results includes data up to a 
lower diameter limit of 2 um, but for this bin only two particles 

—~10° were detected for all three replicates combined, leading to a 

ay very high uncertainty in the particle concentration at this size. 

= The ESZ data extend down to 1 um, but the data for diame- 

> ter limit of 1 um are in the anomalous region. We encourage 
a future comparison between RMM and ESZ in the region of 
overlap 

10° 


—— Flow imaging 

- +- - ESZ (unscaled) 

- <- - ESZ (scaled, aligned) 
---©-- ESZ (scaled, random) 


d (um) 


Figure 7. Electrical sensing zone data for N compared with flow imag- 
ing data, with and without diameter scaling of the ESZ diameters. Scal- 
ing is shown for particles that are randomly aligned (open diamond 
symbols, dashed lines) and aligned with the flow field (open diamond 
symbols, dotted lines). For flow imaging, error bars indicate standard 
error of the mean for the values reported by multiple laboratories. For 
ESZ, error bars indicate the standard error of the mean of the two data 
sets reported for a 100-um orifice. At d = 2 um, the ESZ data point 
indicates only the results of one laboratory with a 50-um orifice. 


overcorrection, possibly because the QPI measurements were 
performed on particles that were stationary on a glass slide. 
The method of section Particle Morphology assumes that the 
particle depth is equal to the particle width, but in fact the par- 
ticles likely settle to the most gravitationally stable position, in 
which the particle has minimum thickness in the z direction. 
This settling effect will give a value of dy/dy x that is too low. At 
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CONCLUSIONS 


The combined data sets of this comparison provide a well- 
controlled and extensive data set to study discrepancies be- 
tween the different counting methods. The discrepancies in par- 
ticle counts of the ETFE suspension by the different measuring 
methods (a factor of 10 times in the worst cases) were compa- 
rable to the discrepancies seen for particles in actual protein 
solutions. 

Selected subsets of the comparison data showed good repro- 
ducibility, comparable with the uncertainty of the ETFE sus- 
pension. In particular, for light obscuration measurements at 
a lower diameter limit of 5 um, the RSD values were approxi- 
mately 25%, and for flow imaging instruments of a single man- 
ufacturer, with fixed instrument series, RSD values were ap- 
proximately 30% for all diameter limits. These values illustrate 
that for controlled instrument parameters, good reproducibil- 
ity of particle counts can be obtained through a broad section 
of the biopharmaceutical industry, device and equipment man- 
ufacturers, and academic and government laboratories. 

Better agreement between the different methods, or between 
instruments of different settings or manufacturer, will be the 
next challenge. Our partially successful attempt at adjusting 
the ESZ reported diameter to match an area-based diameter 
is an example of the bias correction methods that need to be 
developed. 

Results of the comparison also provide useful information for 
the development of ETFE suspensions as a reference material. 
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The ETFE suspension proved generally useful as a tool to ascer- 
tain instrument performance, with the exception of ESZ instru- 
ments near the lower limit of the installed orifice. Increasing 
the particle concentration for particle diameters greater than 
15 um would increase the number of particles measured in the 
larger size bins, giving measurement results with less variabil- 
ity and reducing the effects of thread debris. The presence of 
data sets with very low values suggests that the instructions 
on resuspension of the sample were not clear enough. Sedimen- 
tation of the particles may have been a contributing factor as 
well; we are working with collaborators to mitigate this prob- 
lem by adding viscosity modifiers to the ETFE suspension. It 
will also be useful to reinforce in the instructions that resus- 
pension and stirring sample prior to use is necessary. The good 
success with robotic and continuously stirred samples demon- 
strated that the ETFE suspension is compatible with advanced 
sample handling instrumentation. 
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